منابع مشابه
Imprecise Markov chains with absorption
Consider a discrete time Markov chain X = {X(n), n = 0, 1, . . .} with finite state space S = {−1} ∪ C, where C = {0, . . . , s} is a single communicating class with all states aperiodic. Assuming −1 can be reached from C, absorption is certain, making the limiting distribution (1, 0, . . . , 0). Instead of considering the limiting distribution, then, we condition at non-absorption at each time...
متن کاملA Pointwise Ergodic Theorem for Imprecise Markov Chains
We prove a game-theoretic version of the strong law of large numbers for submartingale differences, and use this to derive a pointwise ergodic theorem for discrete-time Markov chains with finite state sets, when the transition probabilities are imprecise, in the sense that they are only known to belong to some convex closed set of probability measures.
متن کاملImprecise stochastic processes in discrete time: global models, imprecise Markov chains, and ergodic theorems
Article history: Received 9 December 2015 Received in revised form 18 April 2016 Accepted 20 April 2016 Available online 29 April 2016
متن کاملEmpirical Bayes Estimation in Nonstationary Markov chains
Estimation procedures for nonstationary Markov chains appear to be relatively sparse. This work introduces empirical Bayes estimators for the transition probability matrix of a finite nonstationary Markov chain. The data are assumed to be of a panel study type in which each data set consists of a sequence of observations on N>=2 independent and identically dis...
متن کاملImprecise Continuous-Time Markov Chains: Efficient Computational Methods with Guaranteed Error Bounds
Imprecise continuous-time Markov chains are a robust type of continuous-time Markov chains that allow for partially specified time-dependent parameters. Computing inferences for them requires the solution of a non-linear differential equation. As there is no general analytical expression for this solution, efficient numerical approximation methods are essential to the applicability of this mode...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: International Journal of Approximate Reasoning
سال: 2010
ISSN: 0888-613X
DOI: 10.1016/j.ijar.2010.08.008